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(54) Data transmission method 

(57) In a data transmission method of the present 
invention, not only when relay of input packets is per- 
formed but also transmission of a retransmission packet 
or a correction packet is performed, changes in an out- 
put rate due to output rate control is suppressed, and 
data transmission is efficiently performed according to a 
capacity of an output channel. A data transmission 
device comprises a packet priority decision unit 1 5 for 
deciding priorities of input packets, a retransmission 
packet, and an FEC packet, an output delay calculation 
unit 17 for calculating a delay time until data of the 
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respective packets is reproduced by a receiving termi- 
nal, and an FEC packet generation unit 19 for generat- 
ing an FEC packet containing an error correcting code 
which corresponds to a packet designated on the basis 
of the priorities of the respective packets. When trans- 
mission of the retransmission packet and the FEC 
packet together with the input packets is performed, 
fower priority packets corresponding to a size of packets 
which are additionally transmitted are thinned out. 
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Description 

FIELD OF THE INVENTION 

[0001 ] The present invention relates to a data trans- 
mission method and, more particularly, to a method for 
relaying packets which are successively input from a 
transmitting end, to output the same to a receiving ter- 
minal, as well as controlling an output rate. 

BACKGROUND OF THE INVENTION 

[0002] Figs. 13(a) and 13(b) are diagrams for 
explaining a prior art data transmission method and 
showing processing in a relay server. 
[0003] As shown in fig. 1 3(a), a prior art relay server 
performs relay processing of receiving packets which 
are successively input from a transmitting end and suc- 
cessively outputting the received packets to a receiving 
terminal. 

[0004] in this prior art relay server, when an input 
rate is higher with relative to a channel capacity at an 
output end, overflow occurs in a transmission queue M 
in the relay server. Accordingly, as shown in fig. 13(b), 
on the basis of information about priorities attached to 
respective packets, the prior art relay server outputs 
only higher priority packets Pa having priorities of a pre- 
determined value or higher, with thinning out lower pri- 
ority packets Pb having priorities lower than the 
predetermined value. 

[0005] Hereinafter, brief descriptions are given of 
data structures of the packets Pa and Pb, and a detailed 
construction of the data transmission device as a prior 
art relay server. 

[0006] Figs.14 are diagrams illustrating data struc- 
tures of the packets. 

[0007] Each of the packets Pa and Pb transmitted 
by the above-described transmission method com- 
prises a data part Pd for storing digital data correspond- 
ing to a medium, such as a video image, a voice, and a 
character, and a header part Ph for storing relevant 
information indicating an attribute or the like of the dig- 
ital data, as shown infigs.14(a) and 14(b). 
[0008] In the header part, information indicating a 
priority of data stored in the data part (hereinafter, sim- 
ply referred to a priority) are stored as one of the rele- 
vant information. For example, the packet Pa is a higher 
priority packet having a value "1" indicating that the pri- 
ority is higher, stored in its header part Ph. The packet 
Pb is a lower priority packet having a value "2" indicating 
that the priority is lower, stored in its header part Ph. 
[0009] In addition, fig. 1 5 is a block diagram illustrat- 
ing a structure of this data transmission device (relay 
server). 

[0010] This data transmission device 200 consti- 
tutes a relay server for relaying transmission data 
between a distribution server (transmitting end) and a 
terminal (receiving end), and has a receiving unit 1 1 for 
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receiving input packets which are transmitted from the 
distribution server, a transmission queue management 
unit 12 for setting an order of transmitting the received 
input packets on the basis of predetermined informa- 
5 tion, and a transmission unit 13 for transmitting the 
respective packets in the transmission order set by the 
management unit 12. 

[0011] The transmission queue management unit 
12 includes a transmission queue (not shown) as a data 
w buffer for temporarily storing the input packets received 
by the receiving unit 1 1 . 

[001 2] In addition, the data transmission device 200 
has a packet priority decision unit 1 5 for deciding priori- 
ties of the input packets. In the transmission queue 

is management unit 12, the transmission order is decided 
by thinning out lower priority packets in the transmission 
queue on the basis of the decided priorities and higher 
priority packets in the transmission queue are output to 
the transmission unit 13 in the decided order. 

20 [001 3] However, since the prior art relay server per- 
forms a simple output rate control of not transmitting 
lower priority packets but transmitting only higher prior- 
ity packets, the output rate may be lower than required, 
or the output rate may be changed considerably with the 

25 output rate control. 

[0014] In addition, occurrence of a transmission 
error on a channel cannot be avoided. In parenthesis, a 
bit error rate in a wired section is about 10~ 5 to 10 7 and 
a bit error rate in a wireless section is about 10" 3 Partic- 

30 ularly, in a data transmission method in which a repro- 
duction quality depends on a transmission quality of 
end-to-end (between a distribution server and a receiv- 
ing terminal), such as a RTP (Real-Time Transport Pro- 
tocol) method, the transmission quality in a wireless 

35 section signif icantly influences the reproduced quality. 
[001 5] Accordingly, in order to recover the transmis- 
sion error, the relay server retransmits a packet in 
accordance with a retransmission request from a 
receiving terminal end or transmits to a predetermined 

40 packet, a correction packet containing an error correct- 
ing code for correcting a data error of the packet. How- 
ever, only with the transmission control according to the 
priorities of the input packets, when retransmission of a 
packet or transmission of a correction packet is per- 

45 formed, the output rate in the relay server increases and 
thereby the output rate exceeds a value corresponding 
to the channel capacity. 

SUMMARY OF THE INVENTION 

50 

[001 6] It is an object of the present invention to pro- 
vide a data transmission method which can suppress 
changes in the output rate due to the output rate control, 
not only when relay of input packets is performed but 
55 also when transmission of a retransmission packet or a 
correction packet is performed, as well as perform 
transmission of packets efficiently according to the 
capacity of the output channel. 
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[001 7] Other objects and advantages of the present 
invention will become apparent from the detailed 
description and specific embodiments described are 
provided only for illustration since various additions and 
modifications within the spirit and scope of the invention 
will be apparent to those of skill in the art from the 
detailed description. 

[0018] According to a 1st aspect of the present 
invention, a data transmission method for performing 
relay processing of relaying plural input packets which 
are successively input from a transmitting end, to output 
the same to a receiving terminal, as well as performing 
at least one processing of processing of retransmitting 
an input packet which is instructed to be retransmitted 
from the receiving terminal and processing of transmit- 
ting an correction packet containing an error correcting 
code for a predetermined input packet, comprises: deci- 
sion processing of deciding a priority attached to each 
input packet from the transmitting end and priorities 
attached to at least one packet of the input packet which 
is instructed to be retransmitted and the correction 
packet; and output processing of outputting the input 
packets as well as outputting at least one packet of the 
input packet which is instructed to be retransmitted and 
the correction packet, and in the output processing, 
lower priority packets having priorities lower than a pre- 
determined value, corresponding to a size of the input 
packet which is to be retransmitted or the correction 
packet which is to be transmitted, are thinned out. 
Therefore, not only when relaying of the input packets is 
performed but also when transmission of the retrans- 
mission packet or the correcting packet is performed, 
changes in an output rate can be suppressed, as well as 
data transmission can be performed efficiently accord- 
ing to a capacity of an output channel. 
[0019] According to a 2nd aspect of the present 
invention, a data transmission method for relaying plural 
packets which are successively input from a transmit- 
ting end, to output the same to a receiving terminal, 
comprises: decision processing of deciding a priority 
attached to the respective packet; and rearrangement 
processing of rearranging the successively input pack- 
ets, with a group comprising a predetermined number of 
packets as a process unit, such that the packets in each 
group are transmitted in the order of descending priori- 
ties, and in the rearrangement processing, a range of 
the packets in the respective group which are to be sub 
jected to the rearrangement processing is decided such 
that all packets from a first input packet to a last input 
packet in the respective group are received by the 
receiving terminal in time for reproduction times There- 
fore, there is an increase in a possibility of a retransmis- 
sion request for a higher priority packet being issued 
prior to a time limit which is decided on the basis of a 
reproduction time in the receiving terminal (arrival time 
limit in the terminal). 

[0020] According to a 3rd aspect of the present 
invention, a data transmission method for relaying plural 



packets which are successively input from a transmit- 
ting end, to output the same to a receiving terminal, 
comprises: decision processing of deciding a priority 
attached to the respective packet; and output process- 

5 ing of performing thinning-out processing for the plural 
packets to thin out part of the packets and outputting 
remaining packets, and in the output processing, the 
thinning-out processing is performed for plural packets 
having same priorities, which are input from the trans- 

10 mitting end, such that intervals between reproduction 
times of data corresponding to the respective plural 
packets received by the receiving terminal are equal. 
Therefore, at the receiving end, disorder in a repro- 
duced image due to the thinning -out of packets can be 

75 suppressed. 

[0021] According to a 4th aspect of the present 
invention, a data transmission method for relaying plural 
packets successively input from a transmitting end, to 
output the same to a receiving terminal, comprises: 

20 decision processing of deciding a priority attached to 
the respective packet, and output processing of per- 
forming thinning-out processing for the plural packets to 
thin out part of the packets and outputting remaining 
packets, and in the output processing, when lower prior- 

25 ity packets having lower priorities, which lower priority 
packets are situated between two. i.e.. former and latter 
higher priority packets having higher priorities, are to be 
thinned out from the plural packets, thinning-out is per- 
formed successively from a lower priority packet which 

30 is nearer to the latter higher priority packet among the 
two higher priority packets. Therefore, when data which 
is coded according to MPEG system is transmitted, 
omission of data which is referred to in decoding at the 
receiving end can be avoided, thereby preventing more 

35 degradation in an image quality than required due to the 
packet thinning-out processing. 
[0022] According to a 5th aspect of the present 
invention, a data transmission method for relaying plural 
packets successively input from a transmitting end, to 

40 output the same to a receiving terminal, comprises: 
decision processing of deciding a priority attached to 
the respective packet; and output processing of per- 
forming thinning-out processing for the plural packets to 
thin out part of the packets and outputting remaining 

45 packets, and in the thinning-out processing in the output 
processing, plural packets having the same priorities 
are thinned out collectively. Therefore, when data which 
is coded according to MPEG system is transmitted, 
transmission of data which does not contribute toward 
so keeping the image quality is avoided, whereby the 
transmission rate is efficiently reduced according to the 
image quality obtained at the receiving end. 
[0023] According to a 6th aspect of the present 
invention, a data transmission method for relaying plural 
55 packets which are successively input from a transmit- 
ting end, to output the same to a receiving terminal, 
comprises: number decision processing of deciding a 
sequence numbers attached to the respective packet; 
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priority decision processing of deciding a priority 
attached to the respective packet; and output process- 
ing of performing thinning-out processing for the plural 
packets to thin out part of the packets and outputting 
remaining packets, wherein in the thinning-out process- 5 
ing in the output processing, the sequence numbers of 
packets to be output are rewritten such that discontinu- 
ity in sequence numbers attached to the respective 
packets due to the thinning-out of packets does not 
occur. Therefore, adverse influences affecting on occur- w 
rence of a retransmission request or calculation of 
packet loss due to thinning-out of packets can be 
avoided. 

[0024] According to a 7th aspect of the present 
invention, a data transmission method for relaying plural 15 
packets which are successively input from a transmit- 
ting end. to output the same to a receiving terminal, 
comprises: detection processing of detecting an error 
occurring rate on an output end channel; and when the 
error occurring rate is a predetermined rate or higher, 20 
performing at least one of repeat transmission process- 
ing of repeatedly outputting a predetermined packet, 
and correction packet transmission processing of trans- 
mitting a correction packet containing an error correct- 
ing code which corresponds to a predetermined packet 25 
Therefore, recovery for communication errors can be 
performed in accordance with the reception state, 
together with the transmission rate control. 
[0025] According to a 8th aspect of the present 
invention, the data transmission method of the 7th so 
aspect comprises: decision processing of deciding a 
priority attached each of the respective packets which 
are successively input from the transmitting end; and 
performing, only to packets having priorities of a prede- 
termined value or higher, at least one processing of the 35 
repeat transmission processing and the correction 
packet transmission processing. Therefore, transmis- 
sion rate control according to a reception state can be 
performed as well as changes in the transmission rate 
due to the transmission rate control can be suppressed. 40 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0026] 

45 

Fig. 1 is a block diagram illustrating a data transmis- 
sion device according to a first embodiment of the 
present invention . 

Figs.2(a) and 2(b) are diagrams schematically illus- 
trating transmission rate control in the data trans- 50 
mission device of the first embodiment. Fig. 2 (a) 
shows a state where input packets are stored in a 
transmission queue M of the data transmission 
device and f ig.2(b) shows a state where an order of 
transmitting the packets in the transmission queue 55 
is set. Fig.2(c) shows a data structure of a retrans- 
mission packet and f ig.2(d) shows a data structure 
of an FEC packet. 



Fig 3 is a block diagram illustrating a data transmis- 
sion device according to a second embodiment of 
the present invention. 

Figs.4(a) and (b) are diagrams schematically illus- 
trating transmission rate control in the data trans- 
mission device of the second embodiment. Fig. 4(a) 
shows a state where input packets are stored in a 
transmission queue M in the data transmission 
device and f ig.4(b) shows a state where the packets 
in the transmission queue M are rearranged. 
Fig.5 is a block diagram illustrating a data transmis- 
sion device according to a third embodiment of the 
present invention. 

Figs. 6(a) -6(c) are diagrams schematically illustrat- 
ing transmission rate control in the data transmis- 
sion device of the third embodiment. Fig.6(a) shows 
a state where input packets are stored in a trans- 
mission queue M in the data transmission device. 
Fig. 6(b) shows a state where thinning-out process- 
ing is performed for the packets in the transmission 
queue M in accordance with priorities. Fig.6(c) 
shows a state where thinning-out processing is per- 
formed for the packets in the transmission queue M 
in accordance with time stamps. 
Figs. 7(a) -7(c) are diagrams schematically illustrat- 
ing transmission rate control in a data transmission 
device according to a variation 1 of the third embod- 
iment. Fig. 7(a) shows a state where input packets 
are stored in a transmission queue M in the data 
transmission device. Fig. 7(b) shows a state where 
a first thinning-out processing is performed in the 
transmission queue M. Fig. 7(c) shows a state 
where a second thinning-out processing is per- 
formed in the transmission queue M. 
Figs.8(a)-8(c) are diagrams schematically illustrat- 
ing transmission rate control in a data transmission 
device according to a variation 2 of the third embod- 
iment. Fig. 8(a) shows a state where input packets 
are stored in a transmission queue M in the data 
transmission device. Fig.8(b) shows a state where 
a first thinning-out processing is performed in the 
transmission queue M. Fig. 8(c) shows a state 
where a second thinning-out processing is per- 
formed in the transmission queue M. 
Fig. 9(a) is a block diagram illustrating a data trans- 
mission device according to a fourth embodiment of 
the present invention and f ig.9(b) is a diagram illus- 
trating a data structure of an input packet. 
Figs. 10(a)- 10(c) are diagrams schematically illus- 
trating transmission rate control in the data trans- 
mission device of the fourth embodiment. Fig. 10(a) 
show a state where input packets are stored in the 
transmission queue M in the data transmission 
device. Fig. 10(b) shows a state where processing 
of thinning out lower priority packets in the trans- 
mission queue M is performed. Fig. 10(c) shows a 
state where processing of rewriting the sequence 
numbers of the higher priority packets in the trans- 
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mission queue M is performed. 
Fig. 11 is a block diagram illustrating a data trans- 
mission device according to a fifth embodiment of 
the present invention. 

Figs. 12(a) and (b) are diagrams schematically illus- 
trating transmission rate control in the data trans- 
mission device of the fifth embodiment. Fig. 12(a) 
shows a state where input packets are stored in the 
transmission queue M in the data transmission 
device. Fig. 12(b) shows a state where a repeat 
transmission packet and an FEC packet are added 
to the transmission queue M. 
Figs. 13(a) and (b) are diagrams illustrating trans- 
mission rate control in a prior art data transmission 
device. Fig. 13(a) shows a state where input pack- 
ets are stored in a transmission queue M in a relay 
server and fig. 13(b) shows a state where thinning- 
out processing is performed for packets in the 
transmission queue M in the relay server. 
Figs. 14(a) and (b) are diagrams for explaining data 
structures of the input packets. Fig. 14(a) shows a 
data structure of a higher priority packet and 
fig. 14(b) shows a data structure of a lower priority 
packet. 

Fig. 15 is a block diagram illustrating a priori art data 
transmission device for relaying packets by a prior 
art data transmission method. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0027] Hereinafter, embodiments of the present 
invention will be described. 

(Embodiment 1.) 

[0028} A data transmission method according to a 
first embodiment of the present invention performs, for 
input packets from a transmitting end, and an input 
packet instructed to be retransmitted (retransmission 
packet) and a correction packet (FEC packet) contain- 
ing an error correcting code, decision of priorities 
attached to the respective packets and transmits only 
packets having priorities of a predetermined value or 
higher. 

[0029] Fig.1 is a block diagram illustrating the data 
transmission device according to the first embodiment. 
[0030] A data transmission device 101 of the first 
embodiment constitutes a relay server for relaying 
transmission data between a distribution server (trans- 
mitting end) and a terminal (receiving end). 
[0031] This data transmission device 101 has a 
receiving unit 1 1 for receiving input packets transmitted 
from the distribution server, a transmission queue man- 
agement unit 12a for setting an order of transmitting the 
received input packets, a packet to be retransmitted 
(retransmission packet), and an FEC (Forward Error 
Correction) packet (correction packet) containing an 



error correcting code, on the basis of predetermined 
information, and a transmission unit 13 for transmitting 
the respective packets in the transmission order set by 
the management unit 12a. 

5 [0032] The transmission queue management unit 
12a includes a transmission queue (not shown) as a 
data buffer for temporarily storing the input packets 
received by the receiving unit 11. 
[0033] Further, the data transmission device 101 

w has a retransmission buffer 18a for storing a predeter- 
mined input packet as a retransmission packet, a packet 
priority decision unit 15 for deciding priorities of the 
input packets, the retransmission packet, and the FEC 
packet, and a retransmission buffer management unit 

is 18 for controlling the retransmission buffer 18a on the 
basis of the decided priorities of the packets such that 
data of packets having priorities of a predetermined 
value or higher are stored in the buffer 18a. 
[0034] Further, the data transmission device 101 

20 has a retransmission instruction receiving unit 14 for 
receiving an instruction to request retransmission of a 
packet from the receiving terminal, and an FEC packet 
generation unit 19 for generating an FEC packet (cor- 
recting packet) containing an error correcting code 

25 which corresponds to a packet designated on the basis 
of the priorities of the respective packets. 
[0035] Further, the data transmission device 101 
has an output delay calculation unit 1 7a for calculating, 
on the basis of the transmission order information of 

30 each packet from the transmission queue management 
unit 12a. a delay time until data of each packet in the 
transmission queue management unit 12a is repro- 
duced by the receiving terminal (reproduction delay 
time), and a transmission packet decision unit 16 for 

35 deciding a packet to be transmitted, on the basis of the 
retransmission request from the receiving end, the pri- 
ority information of each packet, and the reproduction 
delay time of each packet, and thereby the decision by 
the decision unit 16 is output to the transmission queue 

40 management unit 12a as predetermined information. 
[0036] Next, functions and effects will be described. 
[0037] Figs. 2 are diagrams schematically illustrat- 
ing transmission rate control in the data transmission 
device of the first embodiment. Fig.2(a) shows a state 

45 where packets (input packets) transmitted by the distri- 
bution server are stored in the transmission queue in 
the relay server (data transmission device) 101 . Fig.2(b) 
shows a state where the transmission order of the pack- 
ets in the transmission queue in the relay server is set. 

so [0038] In the data transmission method of the first 
embodiment, when transmission of a retransmission 
packet Pr and an FEC packet Pfec is performed 
together with transmission of input packets Pa and Pb, 
lower priority packets Pb corresponding to a size of 

55 these packets to be transmitted are thinned out. thereby 
suppressing changes in the output rate. 
[0039] Here, each packet transmitted from the dis- 
tribution server, i.e., each of higher priority packets Pa 
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and lower priority packets Pb comprises a data part Pd 
for storing digital data which corresponds to a medium, 
such as a video image, a voice, and a character, and a 
header part Ph for storing relevant information indicat- 
ing an attribute of the digital data, as shown in figs. 1 4(a) 
and (b). In addition, each of the retransmission packet 
Pr and the FEC packet Pfec also comprises a data part 
Pd for storing digital data and a header part Ph for stor- 
ing relevant information indicating an attribute of the dig- 
ital data, as shown in figs.2(c) and (d), like the packets 
Pa and Pb. In this case, in the header part Ph in the 
packet, additional information concerning a sequence 
number and a priority and the like is stored as the rele- 
vant information. However, only values of priority infor- 
mation are shown in figs.2, with a value corresponding 
to a higher priority as "1 M and a value corresponding to 
a lower priority as "2". 

[0040] Hereinafter, an operation of the data trans- 
mission device 101 will be brief ly described. 
[0041] In the data transmission device 101 as the 
relay server, the received input packets Pa and Pb are 
supplied to the transmission queue management unit 
12a as well as to the retransmission buffer 18a. In addi- 
tion, to the transmission queue management unit 12a. a 
retransmission packet Pr corresponding to an input 
packet to which a retransmission request is issued from 
the receiving terminal end is supplied from the retrans- 
mission buffer 18a, as well as a correction packet Pfec 
corresponding to a predetermined input packet is sup- 
plied from the FEC packet generation unit 19. 
[0042] At this time, a priority of respective packet in 
the transmission queue M in the transmission queue 
management unit 12a is decided by the packet priority 
decision unit 15 as well as a reproduction delay time of 
the respective packet is calculated by the output delay 
calculation unit 17a, and the decided priority and repro- 
duction delay time which correspond to the respective 
packet are output to the transmission packet decision 
unit 16. In addition, in the transmission packet decision 
unit 16, on the basis of the priorities of the input packets 
Pa and Pb and the retransmission packet Pr, an instruc- 
tion as for whether an FEC packet (correction packet) 
Pfec containing an error correcting code for these pack- 
ets is generated or not is output to the FEC packet gen- 
eration unit 19. 

[0043] Then, when transmission of the retransmis- 
sion packet Pr and the FEC packet Pfec is performed 
together with the transmission of the input packets Pa 
and Pb, the transmission packet decision unit 16 
instructs the transmission queue management unit 12a 
to thin out lower priority packets corresponding to a size 
of the retransmission packet and the FEC packet which 
are to be transmitted. In the management unit 12a, the 
transmission order of the packets is set on the basis of 
this instruction (seefig.2(b)). In the transmission unit 13, 
processing of transmitting the input packets, the 
retransmission packet, and the FEC packet to the 
receiving terminal in the set transmission order is per- 



formed. 

[0044] Here, in the retransmission buffer 18a, with 
the control by the retransmission buffer management 
unit 18, the input packets are stored in the retransmis- 
5 sion buffer 18a as retransmission packets and data of 
packets which will be late for the reproduction times are 
successively freed (abandoned) by the management 
unit 18. 

[0045] As described above, in the first embodiment, 

w when the transmission of the retransmission packet Pr 
and the FEC packet Pfec is performed together with the 
transmission of the input packets Pa and Pb, lower pri- 
ority packets Pb corresponding to the size of these 
packets to be transmitted are thinned out. Therefore, 

w not only when the relay of the input packets is per- 
formed but also when the transmission of the retrans- 
mission packet and the correction packet is performed, 
changes in the output rate can be suppressed and fur- 
ther the data transmission can be efficiently performed 

20 according to the capacity of the output channel. 

[0046] In this first embodiment, when the transmis- 
sion of the retransmission packet and the FEC packet is 
performed together with the transmission of the input 
packets, lower priority packets corresponding to the size 

25 of these packets to be transmitted are thinned out. How- 
ever, when it is decided that a predetermined retrans- 
mission packet and FEC packet are transmitted and 
then a packet having a long reproduction delay time 
(i.e., a packet which will be late for the reproduction time 

30 at the receiving end) arises from that decision, transmis- 
sion of lower priority packets having priorities lower than 
the priorities of the retransmission packet and the FEC 
packet can be stopped. 

[0047] Further, the data transmission device of the 
35 first embodiment performs transmission of the retrans- 
mission packet and the FEC packet together with the 
transmission of the input packets. However, the data 
transmission device can perform the relay processing of 
relaying input packets which are successively input from 
40 the distribution server (transmitting end) to output the 
same to the receiving terminal, as well as performs only 
one of the retransmission of an input packet which a 
retransmission instruction is issued from the receiving 
terminal and the transmission of a correction packet 
45 containing an error correcting code which corresponds 
to a predetermined input packet. 

(Embodiment 2.) 

so [0048] A data transmission method according to a 
second embodiment of the present invention includes 
rearrangement processing of rearranging successively 
input packets, with a group comprising a predetermined 
number of packets as a process unit, such that packets 

55 in the respective group are transmitted in the order of 
descending priorities, and in the rearrangement 
processing, a range of the packets in the respective 
group, which are to be subjected to the reanangement 



6 



< E P 1 009 1 36 A2J_ > 



11 



EP1 009138 A2 



12 



processing is decided such that all packets from a first 
input packet to a last input packet in the respective 
group are received by the receiving terminal in time for 
reproduction times. 

[0049] Fig.3 is a block diagram illustrating the data 
transmission device according to the second embodi- 
ment. 

[0050] A data transmission device 102 of the sec- 
ond embodiment constitutes a relay server for relaying 
transmission data between a distribution server (trans- 
mitting end) and a terminal (receiving end). This data 
transmission device 102 of the second embodiment 
has, like the data transmission device 101 of the first 
embodiment, a receiving unit 11 for receiving input 
packets transmitted from the distribution server, a trans- 
mission queue management unit 1 2b for setting a trans- 
mission order of the received input packets on the basis 
of predetermined information, and a transmission unit 
13 for transmitting the respective packets in the trans- 
mission order set by the management unit 12b. 
[0051] Further, the data transmission device 102 
has a packet priority decision unit 15 for deciding priori- 
ties of the input packets, an output delay calculation unit 
17b for calculating, on the basis of transmission order 
information of each packet from the transmission queue 
management unit 12b. a delay time until data of each 
packet in the transmission queue management unit 12b 
is reproduced by the receiving terminal (reproduction 
delay time), and a transmission packet rearrangement 
information generation unit 21 for generating rearrange- 
ment information for changing a transmission order of 
plural packets included in each group (unit for the rear- 
rangement processing) in the transmission queue man- 
agement unit 12b on the basis of the priorities and the 
delay times of the respective input packets. 
[0052] Here, the transmission queue management 
unit 12b has a transmission queue (not shown) as a 
data buffer for temporarily storing the input packets 
received by the receiving unit 1 1 and rearranges the 
input packets in the transmission queue so as to be 
transmitted in the transmission order set by the trans- 
mission packet rearrangement information generation 
unit 21. 

[0053] Next, functions and effects will be described. 
[0054] Figs.4 are diagrams schematically illustrat- 
ing transmission rate control in the data transmission 
device of the second embodiment. Fig. 4(a) shows a 
state where packets (input packets) transmitted from 
the distribution server are stored in the transmission 
queue M in the relay server (data transmission device) 
102. Fig.4(b) show a state where the packets in the 
transmission queue M in the relay server are rear- 
ranged. 

[0055] As shown in fig.4(a). when lower priority 
packets Pb and higher priority packets Pa are alter- 
nately input to the data transmission device 102 as a 
relay server, the receiving unit 1 1 receives these input 
packets and outputs the same to the transmission 
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queue management unit 12b. At this time, priorities of 
the input packets in the transmission queue manage- 
ment unit 12b are decided by the packet priority deci- 
sion unit 15, and the reproduction delay times of these 

5 input packets (delay times until the input packets are 
reproduced by the receiving terminal) are calculated by 
the output delay calculation unit 1 7b. 
[0056] Then, by the transmission packet rearrange- 
ment information generation unit 21, rearrangement 

io processing is performed for a predetermined number of 
packets in the transmission queue management unit 
12b, which can be transmitted in time for the reproduc- 
tion times, such that higher priority packets are transmit- 
ted prior to lower priority packets and thereby the 

is transmission order is set. Here, the number of packets 
which can be transmitted in time for the reproduction 
times comprise plural packets constituting a group as a 
unit for the rearrangement processing. As shown in 
fig.4(b), rearrangement of the packets is performed by 

20 the transmission queue management unit 12b on the 
basis of the transmission order set as described above. 
The rearranged input packets are successively trans- 
mitted by the transmission unit 13 to the receiving termi- 
nal end. 

25 [0057] As described above, in the data transmission 
method of the second embodiment, the processing of 
rearranging packets which are successively input from 
the transmitting end such that the respective packets 
are transmitted in the order of descending priorities of 

30 the packets is performed such that all packets after this 
rearrangement can be transmitted in time for the repro- 
duction times in the receiving terminal. Therefore, 
higher priority packets are preferentially transmitted 
prior to lower priority packets such that the reproduction 

35 delay times of the packets are shorter, i.e., such that the 
packets will be well in time for the reproduction time. 
This increases a possibility of a retransmission request 
for a higher priority packet being issued prior to a time 
limit which is decided on the basis of the reproduction 

40 time at the receiving terminal (arrival time limit at the ter- 
minal). 

[0058] In the second embodiment, the method for 
merely rearranging input packets on the basis of the pri- 
orities is shown. However, rearrangement of the input 

45 packets can be performed within a channel (i.e., a 
medium such as a video image, a voice, or a character) 
or can be performed between different channels. 
[0059] For example, when input packets are rear- 
ranged within a channel, the receiving terminal end can 

50 compile packets corresponding to the channel on the 
basis of the sequence numbers and thereby reconstruct 
data. 

[0060] In addition, when input packets are rear- 
ranged between different channels, the receiving termi- 
55 nal end can compile packets corresponding to a 
channel on the basis of a channel number attached to a 
header of RTP and a sequence number of each packet 
and thereby reconstruct data of the channel. 
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[0061] Further, in the second embodiment, the 
processing of rearranging packets which are succes- 
sively input from the transmitting end such that the 
respective packets are transmitted in the order of 
descending priorities is performed for every packets 5 
within such a range that all packets subjected to this 
rearrangement processing can be received by the 
receiving terminal in time for the reproduction times 
However, the transmission control according to the sec- 
ond embodiment can be performed not only for the w 
transmission of packets which are input successively 
from the transmitting end but also for at least one of the 
retransmission of a packet and the transmission of an 
FEC packet in the first embodiment, and repeat trans- 
mission of a packet. 15 

(Embodiment 3.) 

[0062] When input packets are thinned out succes- 
sively from an input packet at the head in a packet buffer 20 
(transmission queue) for managing the transmission 
order, data reproduction is interrupted for a long time. In 
order to solve this problem, a data transmission method 
according to a third embodiment of the present inven- 
tion performs packet thinning -out processing for input 25 
packets having same priorities such that intervals 
between reproduction times of data corresponding to 
respective packets are equal at the receiving end. 
[0063] Fig.5 is a block diagram illustrating the data 
transmission device according to the third embodiment. 30 
[0064] The data transmission device 103 of the 
third embodiment constitutes, like the data transmission 
devices of the first and second embodiments, a relay 
server for relaying transmission data between a distribu- 
tion server (transmitting end) and a terminal (receiving 35 
end). This data transmission device 103 of the third 
embodiment has a receiving unit 1 1 for receiving input 
packets which are transmitted from the distribution 
server, a transmission queue management unit 12c for 
setting a transmission order of the received input pack- 40 
ets on the basts of predetermined information, and a 
transmission unit 13 for transmitting the respective 
packets in the transmission order set by the manage- 
ment unit 1 2c. 

[0065] Further, the data transmission device 103 45 
has a packet priority decision unit 15 for deciding priori- 
ties of the input packets, a time stamp decision unit 22 
for deciding a time stamp as time information which is 
attached to each packet in the transmission queue man- 
agement unit 1 2c, and a transmission packet thinning- 50 
out unit 23 for deciding packets to be thinned out in the 
transmission queue management unit 12c ( on the basis 
of the decided time stamp and priorities. Here, the time 
stamp is one of the relevant information stored in the 
header part of the packet. 55 
[0066] In addition, the transmission queue manage- 
ment unit 1 2c has a transmission queue (not shown) as 
a data buffer for temporarily storing the input packets 
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received by the receiving unit 1 1 , and performs packet 
thinning-out processing for input packets having the 
same priorities in the transmission queue, on the basis 
of the decision output from the transmission packet thin- 
ning-out unit 23, such that intervals between reproduc- 
tion times of data which corresponds to the respective 
packets are equal at the receiving end. 
[0067] Next, functions and effects will be described. 
[0068] Figs. 6 are diagrams schematically illustrat- 
ing transmission rate control in the data transmission 
device of the third embodiment. Fig. 6(a) shows a state 
where packets (input packets) transmitted from the dis- 
tribution server are stored in the transmission queue M 
in the relay server (data transmission device) 103. 
Fig. 6(b) shows a state where the packets in the trans- 
mission queue M in the relay server are thinned out in 
accordance with the priorities. Fig. 6(c) shows a state 
where the packets in the transmission queue M in the 
relay server are thinned out in accordance with the time 
stamps. 

[0069] While only priorities are shown in figs.6 as 
the relevant information stored in the header parts of the 
respective packets, time stamps are also stored in the 
header parts of actual packets together with other rele- 
vant information 

[0070] As shown in fig.6(a), when lower priority 
packets Pb and higher priority packets Pa are alter- 
nately input to the data transmission device 103 as a 
relay server, the receiving unit 1 1 receives these input 
packets and outputs the same to the transmission 
queue management unit 12c. 

[0071] At this time, priorities of the input packets in 
the transmission queue management unit 12c are 
decided by the packet priority decision unit 15 and time 
stamps of the input packets in the transmission queue 
management unit 12 are decided by the time stamp 
decision unit 22. Then, packets to be thinned out in the 
transmission queue management unit 12c are decided 
by the transmission packet thinning-out unit 23, on the 
basis of the decided time stamps and priorities. 
[0072] Then, in the transmission queue manage- 
ment unit 12c, as shown in fig.6(b), processing of thin- 
ning out lower priority packets Pb is performed on the 
basis of the decision output from the transmission 
packet thinning-out unit 23. Further, as shown in 
f ig.6(c), processing of thinning out packets is performed 
for the input packets Pa having the same priorities, on 
the basis of the decision output from the transmission 
packet thinning-out unit 23, such that intervals between 
reproduction times of data which corresponds to 
respective packets are equal at the receiving end. 
Thereby, packets are transmitted from the transmission 
unit 13 so as to have the equal intervals between the 
reproduction times of data corresponding to the respec- 
tive packets at the receiving end. 
[0073] In this third embodiment, when packets hav- 
ing the same priorities are to be thinned out, the packets 
are thinned out so as to have the equal intervals 
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between the reproduction times. Therefore, at the 
receiving end, disorder in reproduced images due to the 
thinning-out of packets can be suppressed. 
[0074] To be specific, when input packets are 
thinned out successively from an input packet at the s 
head in the packet buffer (transmission queue) for man- 
aging the transmission order, on the basis of the priori- 
ties of the packets, there is a problem that the data 
reproduction is interrupted for a long time. However, in 
this embodiment, the packet thinning-out processing is 10 
performed for the input packets having the same priori- 
ties such that intervals between the reproduction times 
of the data which corresponds to the respective packets 
are equal at the receiving end, whereby long time inter- 
ruption of the data reproduction at the receiving end is 15 
avoided and the disorder in the reproduced image is 
suppressed. 

[0075] In this third embodiment, the packet thin- 
ning-out processing is performed for input packets hav- 
ing the same priorities such that intervals between the 20 
reproduction times of data corresponding to the respec- 
tive packets are equal at the receiving end. However, 
the transmission control according to this third embodi- 
ment can be performed not only for the transmission of 
packets successively input from the transmitting end but 25 
also for at least one of the retransmission of a packet 
and the transmission of an FEC packet in the first 
embodiment, and repeat transmission of a packet. 
{0076] In addition, in the third embodiment, all lower 
priority packets having lower priorities are simultane- 30 
ously thinned out from the input packets in the transmis- 
sion queue. However, the packet thinning-out 
processing can be performed in another way. 
[0077] For example, lower priority packets in the 
transmission queue in the relay server can be thinned 35 
out in stages according to busyness in a data communi- 
cation on a channel (network) at the receiving end. 
[0078] Further, in a data transmission device for 
transmitting a retransmission packet in accordance with 
a retransmission request like the data transmission 40 
device in the first embodiment, lower priority packets in 
the transmission queue in the relay server can be 
thinned out in stages according to the transmission 
state of the retransmission packet. 

45 

(Variation 1 of Embodiment 3.) 

[0079] Hereinafter, as a variation 1 of the third 
embodiment, a brief description will be given of packet 
thinning-out processing of thinning out lower priority 50 
packets in the transmission queue in the relay server in 
stages. 

[0080] Figs.7(a)-(c) are diagrams schematically 
illustrating transmission rate control in a data transmis- 
sion device according to the variation 1 of the third 55 
embodiment. Fig.7(a) shows a state where packets 
(input packets) transmitted from the distribution server 
are stored in the transmission queue M in the relay 



server (data transmission device). Fig. 7(b) shows a 
state where a first thinning-out processing is performed 
in the transmission queue M in the relay server. Fig.7(c) 
shows a state where a second thinning-out processing 
is performed in the transmission queue M in the relay 
server. 

[0081 ] Here, transmission of packets from the distri- 
bution server is performed such that a higher priority 
packet Pa, a first lower priority packet Pb1 , and a sec- 
ond lower priority packet and Pb2 are repeatedly 
received by the relay server. 

[0082] In addition, the higher priority packet Pa is 
one containing image data of a frame which is subjected 
to intra frame coding according to MPEG (Moving Pic- 
ture Expert Group) system. Each of the first and second 
lower priority packets Pb1 and Pb2 is one containing 
image data of a frame which is subjected to inter frame 
coding according to MPEG system. That is, the image 
data of the first lower priority packet Pb1 is subjected to 
coding processing with referring to the image data of the 
forward higher priority packet Pa and the image data of 
the second lower priority packet Pb2 is subjected to 
coding processing with referring to the image data of the 
forward first lower priority packet Pb1. 
[0083] In the data transmission device (relay 
server) according to the variation 1 of the third embodi- 
ment, when the network at the receiving end becomes 
busier, the first thinning-out processing of thinning out 
the second lower priority packets Pb2 which are situ- 
ated just before the higher priority packets Pa is per- 
formed in the transmission queue M in the relay server 
(seefig.7(b)), and the higher priority packets Pa and the 
first lower priority packets Pb1 are transmitted to the 
receiving end by the transmission unit 13. 
[0084] Then, when the network at the receiving end 
becomes further busier, in addition to the first thinning- 
out processing, the second thinning-out processing of 
thinning out the first lower priority packets Pb1 which 
are situated just before the second lower priority pack- 
ets Pb2 is performed in the transmission queue M in the 
relay server (see fig. 7(c)), and only the higher priority 
packets Pa are transmitted to the receiving end by the 
transmission unit 13. 

[0085] Thus, in the variation 1 of the third embodi- 
ment, according to the busyness state of the network, 
lower priority packets containing the image data of 
frames which are subjected to the inter frame coding 
are thinned out in stages in the transmission queue in 
the relay server, starting from the packets just before the 
higher priority packets containing the image data of 
frames which are subjected to the intra frame coding. 
Therefore, when data which is coded according to 
MPEG system is transmitted, more degradation in an 
image quality due to the packet thinning-out processing 
than required can be reduced to the minimum. 
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(Variation 2 of Embodiment 3.) 

[0086] Further, as a variation 2 of the third embodi- 
ment, a brief description is given of packet thinning-out 
processing of thinning out packets in the transmission 5 
queue in the relay server in stages on the basis of the 
time stamps. 

[0087] Figs. 8 are diagrams schematically illustrat- 
ing transmission rate control in the transmission device 
according to the variation 2 of the third embodiment, w 
Fig. 8(a) shows a state where packets (input packets) 
transmitted from the distribution server are stored in the 
transmission queue M in the relay server (data trans- 
mission device). Fig.8(b) shows a state where a first 
thinning-out processing is performed in the transmis- is 
sion queue M in the relay server. Fig. 8(c) shows a state 
where a second thinning-out processing is performed in 
the transmission queue M in the relay server. 
[0088] In this case, plural groups of packets are 
transmitted from the distribution server. One group cor- 20 
responds to one frame and comprises plural packets. 
Therefore, packets in one group have image data of the 
same frame stored in the data part and the same time 
stamp (reproduction time) stored in the header part. For 
example, a packet P1 is a packet constituting a first 25 
group and has a time stamp indicating a reproduction 
time t1 stored in the header part. Similarly, packets P2 
and P3 are packets constituting second and third 
groups, respectively, and have time stamps indicating 
reproduction times t2 and t3 stored in the header parts, so 
Further in this case, the packet P1 is a higher priority 
packet, the packet P2 is a medium priority packet, and 
the packet P3 is a lower priority packet, each having 
information (not shown) indicating the priority stored in 
the header part. 35 
[0089] In the data transmission device (relay 
server) according to the variation 2 of the third embodi- 
ment, when the network at the receiving end becomes 
busier, the first thinning-out processing of thinning out 
all the packets P3 of the third group having the lowest 40 
priorities, is performed in the transmission queue M in 
the relay server (see fig.8(b)), and the higher priority 
packets P1 and the medium priority packets P2 are 
transmitted to the receiving end by the transmission unit 
13. 45 
[0090] Then, when the network at the receiving end 
becomes further busier, in addition to the first thinning- 
out processing, the second thinning-out processing of 
thinning out all the packets P2 of the second group hav- 
ing the medium priorities, is performed in the transmis- so 
sion queue M in the relay server (see f ig.8(c)), and only 
the higher priority packets Pa are transmitted to the 
receiving end by the transmission unit 13. 
[0091] Thus, in the variation 2 of the third embodi- 
ment, according to the busyness state of the network, 55 
all the packets in one group, to which the same time 
stamps are attached, in the transmission queue in the 
relay server are thinned out. Therefore, when data 



which is coded according to MPEG system is transmit- 
ted, transmission of data which does not contribute 
toward keeping the image quality is avoided and reduc- 
tion in the transmission rate can be effectively per- 
formed according to an image quality obtained at the 
receiving end. 

(Embodiment 4.) 

[0092] When packets are thinned out, an excessive 
gap is generated between sequence numbers and 
thereby calculation of an occurring rate of a retransmis- 
sion request or a packet loss rate is adversely affected. 
In order to solve this problem, a data transmission 
method according to a fourth embodiment of the 
present invention performs, when packets input from the 
transmitting end are thinned out and transmitted in 
accordance with a predetermined rule, rewriting of 
sequence numbers of packets to be transmitted such 
that discontinuity in sequence numbers attached to 
respective packets does not occur due to the thinning- 
out of packets. 

[0093] Fig.9(a) is a block diagram illustrating the 
data transmission device according to the fourth 
embodiment. 

[0094] A data transmission device 1 04 of the fourth 
embodiment, like the data transmission devices of the 
first to third embodiments, constitutes a relay server for 
relaying transmission data between a distribution server 
(transmitting end) and a terminal (receiving end). This 
data transmission device 104 of the fourth embodiment 
has a receiving unit 1 1 for receiving input packets which 
are transmitted from the distribution server, a transmis- 
sion queue management unit 1 2d for setting a transmis- 
sion order of the received input packets on the basis of 
predetermined information, and a transmission unit 13 
for transmitting the respective packets in the transmis- 
sion order set by the management unit 12d. 
[0095] Further, the data transmission device 104 
has a packet priority decision unit 15 for deciding priori- 
ties of the input packets, a transmission packet thinning- 
out unit 23a for deciding a packet to be thinned out on 
the basis of priorities or the like of respective packets in 
the transmission queue management unit 12d, and a 
packet header update unit 24 for rewriting a sequence 
number of a packet to be transmitted such that disconti- 
nuity in sequence numbers attached to respective pack 
ets due to the thinning-out of the packets does not 
occur. 

[0096] The transmission queue management unit 
12d has a transmission queue (not shown) as a data 
buffer for temporarily storing the input packets received 
by the receiving unit 1 1 and performs the packet thin- 
ning-out processing for the input packets on the basis of 
decision output from the transmission packet thinning - 
out unit 23a. 

[0097] While a data structure of the input packet in 
the fourth embodiment is the same as those in the 
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above embodiments, the input packet in the fourth 
embodiment includes information concerning a 
sequence number in addition to the information con- 
cerning the priority, as the relevant information stored in 
the header part, as shown in fig.9(b). 5 
[0098] That is, an input packet P(n) (n: integer) 
comprises a data part Pd storing digital data and a 
header part Ph storing sequence number information Is 
and priority information Ip as relevant information relat- 
ing to the digital data. Here, the input packet P(n) is a w 
packet having an sequence number ot "n" and its 
header part Ph contains a value "n" as the sequence 
number information Is. In addition, the header part Ph of 
this packet P(n) contains "V indicating a higher priority 
or "2" indicating a lower priority, as a value of the priority is 
information Ip. 

[0099] Next, functions and effects will be described. 
[01 00] Figs. 1 0 are diagrams schematically illustrat- 
ing transmission rate control in the data transmission 
device 104 of the fourth embodiment. 20 
[0101] Fig. 10(a) show a state where packets (input 
packets) transmitted from the distribution server are 
stored in the transmission queue M in the relay server 
(data transmission device) 104. Fig. 10(b) shows a state 
where thinning-out processing for packets in the trans- 25 
mission queue M in the relay server is performed on the 
basis of the priorities. Fig. 10(c) shows a state where 
rewriting of the sequence numbers of the packets in the 
transmission queue M in the relay server is performed. 
[0102] As shown in fig.1 0(a), packets from a packet 30 
P(0) of sequence number (0) to a packet P(5) of 
sequence number (5) are input as input packets to the 
data transmission device 104 as a relay server. Here, 
the packets P(0), P(2), and P(4) are lower priority pack- 
ets and the packets P(1), P(3), and P(5) are higher pri- 35 
ority packets. 

[0103] The receiving unit 11 receives these input 
packets and outputs the same to the transmission 
queue management unit 12d. Then, priorities of the 
input packets in the transmission queue management 40 
unit 12d are decided by the packet priority decision unit 
15. Further, by the transmission packet thinning-out unit 
23a, packets to be thinned out in the transmission 
queue management unit 12d are decided on the basis 
of the priorities and packets P(1), P(3), and P(5) are 45 
decided as packets to be transmitted, as shown in 
fig. 10(b). At this time, as shown in fig. 10(c), by the 
packet header update unit 24, information in the header 
parts of packets P(1). P(3), and P(5) remaining after the 
thinning-out is performed are updated and, by this so 
updating, the sequence number information Is of the 
packets P(1). P(3), and P(5) which are to be transmitted 
is rewritten such that discontinuity in sequence numbers 
attached to respective packets due to the thinning-out of 
the packets dose not occur. 55 
[01 04] Thereby, packets P( 1 ), P(3), and P(5) having 
the sequence numbers "0", "1", and "2", respectively, 
are successively transmitted to the receiving terminal 



end by the transmission unit 13. 
[0105] In this case, packets are transmitted to a 
receiving terminal end with keeping discontinuity in 
sequence numbers occurring at the transmitting end 
(distribution server) in the relay server, for example, a 
gap (discontinuity in sequence numbers) occurring due 
to packet loss in the Internet. 

[0106] In the above-described fourth embodiment, 
the sequence numbers of the packets to be transmitted 
are rewritten such that discontinuity in the sequence 
numbers attached to respective packets due to the thin- 
ning-out of packets does not occur. Therefore, adverse 
influences on a calculation of a retransmission request 
or packet loss due to the thinning-out of packets can be 
avoided. 

[01 07] Further, in this fourth embodiment, the trans- 
mission of packets to the receiving terminal end is per- 
formed with keeping the gap (discontinuity in the 
sequence numbers) which occurs at the transmitting 
end in the relay server, due to the packet loss in the 
Internet. Therefore, an error packet due to a transmis- 
sion error occurring at the transmitting end in the relay 
server can be recovered by a transmission request from 
the receiving terminal end. 

[0108] In this fourth embodiment, when packets 
input from the transmitting end are thinned out and 
transmitted in accordance with a predetermined rule, 
the sequence numbers of the packets to be transmitted 
are rewritten such that the discontinuity in the sequence 
numbers attached to respective packets due to the thin- 
ning-out of packets does not occur. However, this trans- 
mission control of the fourth embodiment can be 
performed not only for the transmission of packets 
which are successively input from the transmitting end 
but also for at least one of the retransmission of a 
packet and the transmission of an FEC packet in the 
first embodiment, and the repeat transmission of a 
packet. 

(Embodiment 5.) 

[0109] A data transmission device according to a 
fifth embodiment of the present invention performs 
repeat transmission processing of repeatedly outputting 
a predetermined packet, and a correction packet trans- 
mission processing of transmitting a correction packet 
containing an error correcting code which corresponds 
to a predetermined packet, when an error occurring rate 
on an output end channel is a predetermined rate or 
higher. 

[01 10] Fig. 1 1 is a block diagram illustrating the data 
transmission device according to the fifth embodiment. 
[0111] A data transmission device 1 05 according to 
the fifth embodiment, like the data transmission devices 
of the first to fourth embodiments, constitutes a relay 
server for relaying transmission data between a distribu- 
tion server (transmitting end) and a terminal (receiving 
end). The data transmission device 105 has a receiving 
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unit 1 1 for receiving input packets which are transmitted 
from the distribution server, a transmission queue man- 
agement unit 12e for setting a transmission order of the 
received input packets on the basis of predetermined 
information, and a transmission unit 13 for transmitting 
the respective packets in the transmission order set by 
the management unit 12e. 

[0112] Further, the data transmission device 105 
has a packet priority decision unit 1 5 for deciding priori- 
ties of the input packets, a terminal reception state noti- 
fication receiving unit 26 for receiving a reception state 
which is transmitted by RTCP (Real-Time Control Proto- 
col) or the like from the receiving terminal end, such as 
a communication error rate or a reception rate, and an 
error correction packet generation unit (FEC) 28 for 
generating a correction packet (FEC packet) containing 
an error correcting code for a predetermined packet in 
the transmission queue management unit 12e and out- 
putting the correction packet to the transmission queue 
management unit 1 2e. 

[0113] Further, the data transmission device 105 
has a repeat output decision unit 25 for deciding a 
packet to be output repeatedly in the transmission 
queue management unit 12e, on the basis of the deci- 
sion output from the packet priority decision unit 1 5 and 
the terminal reception state notification received by the 
terminal reception state notification receiving unit 26, 
and an FEC packet output decision unit 27 for deciding 
a packet in the transmission queue management unit 
12e, to which packet an FEC packet is to be output, on 
the basis of the decision output from the packet priority 
decision unit 15, and a FEC packet generation unit 28 
for generating an FEC packet Pfec corresponding to a 
predetermined higher priority packet Pa on the basis of 
the decision output from the decision unit 27. 
[0114] Here, the transmission queue management 
unit 12e has a transmission queue (not shown) as a 
data buffer for temporarily storing the input packets 
received by the receiving unit 1 1 and decides a trans- 
mission order of the input packets, a repeat output 
packet and an FEC packet on the basis of the decision 
output from the repeat output decision unit 25 and deci- 
sion output from the FEC packet output decision unit 27. 
[01 1 5] Next, functions and effects will be described 
[011 6] Figs. 1 2 are diagrams schematically illustrat- 
ing transmission rate control in the data transmission 
device of the fifth embodiment. 
[01 17] Fig. 1 2(a) shows a state where packets (input 
packets) transmitted from the distribution server are 
stored in the transmission queue M in the relay server 
(data transmission device) 105. Fig. 12(b) shows a state 
where a repeat transmission packet and an FEC packet 
are added to the transmission queue M. 
[0118] As shown in fig. 12(a), when lower priority 
packets and higher priority packets are alternately input 
to the data transmission device 105 as a relay server, 
the receiving unit 1 1 receives these input packets and 
outputs the same to the transmission queue manage- 



ment unit 12e. At this time, priorities of the input packets 
in the transmission queue management unit 12e are 
decided by the packet priority decision unit 15. In addi- 
tion, a reception state which is transmitted by the RTCP 

5 (Real-Time Control Protocol) or the like from the receiv- 
ing terminal end, such as a communication error rate or 
a reception rate, is received by the terminal reception 
state notification receiving unit 26. 
[01 1 9] In addition, by the repeat output decision unit 

w 25, a packet to be output repeatedly in the transmission 
queue management unit 12e is decided on the basis of 
the decision output from the packet priority decision unit 
1 5 and the terminal reception state notification received 
by the terminal reception state notification receiving unit 

is 26. Then, by the packet repeat output decision unit 25, 
on the basis of this decision by the decision unit 25, a 
higher priority packet to be output repeatedly is decided 
and notified to the transmission queue management 
unit 12e. Further, by the FEC packet output decision 

20 unit 27, a packet in the transmission queue manage- 
ment unit 12e, to which packet a FEC packet (correction 
packet) Pfec is to be output, is decided on the basis of 
the decision output from the packet priority decision unit 
15. Then, by the FEC packet generation unit 28, on the 

25 basis of the decision output from the decision unit 27, a 
FEC packet Pfec for a predetermined higher priority 
packet Pa is generated and output to the transmission 
queue management unit 12e. 

[01 20] Then, from the transmission queue manage- 

30 ment unit 12e, as shown in fig. 12(b), following the pre- 
determined higher priority packet Pa decided by the 
decision unit 25, the same packet Pa1 as this higher pri- 
ority packet is output to the transmission unit 1 3 as well 
as the FEC packet Pfec from the FEC packet generation 

35 unit 28 is output to the transmission unit 13. 

[01 21 ] Then, in addition to the input packets Pa and 
Pb, the same packet Pa1 as the predetermined higher 
priority packet Pa and the corresponding FEC packet 
(correction packet) Pfec are transmitted from the trans- 

40 mission unit 1 3 to the receiving terminal end. 

[0122] To be specific, in the data transmission 
device 105 of the fifth embodiment, only when an error 
rate on the output end channel has a predetermined 
value or higher, repeat transmission of a higher priority 

45 packet having a priority of a predetermined value or 
higher and transmission of an FEC packet for the higher 
priority packet are performed. 

[0123] Thus, in the fifth embodiment, in the data 
transmission device 105 as a relay server which is on a 

so server end for a receiving terminal, upon receipt of a 
report on a reception state (an error rate or a reception 
rate) of the receiving terminal from the RTCP or the like, 
addition of an FEC packet and repeat transmission of a 
predetermined packet are performed according to the 

55 error rate or the transmission rate on the output chan- 
nel, whereby recovery for communication errors can be 
performed together with the transmission rate control, in 
accordance with the reception state. 
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[0124] Further, the data transmission device of the 
fifth embodiment performs addition of an FEC packet 
and repeat transmission, to a packet having a priority of 
a predetermined value or higher, whereby changes in a 
transmission rate due to the transmission rate control 
can be suppressed. 

[01 25] In the fifth embodiment, processing of thin- 
ning out input packets which are transmitted to the 
receiving terminal end is not performed. However, when 
an error rate on the output end channel has a predeter- 
mined value or higher, predetermined packets can be 
thinned out to decrease a transmission rate. 
[01 26] Further, in the fifth embodiment, when an 
error occurring rate on the output end channel is a pre- 
determined rate or higher, the repeat transmission 
processing of outputting a predetermined packet 
repeatedly, and correction packet transmission process- 
ing of transmitting a correction packet containing an 
error correcting code which corresponds to a predeter- 
mined packet are performed. However, the transmission 
control of the fifth embodiment can be performed not 
only for the transmission of packets which are succes- 
sively input from the transmitting end but also for at least 
one of the retransmission of a packet and the transmis- 
sion of an FEC packet in the first embodiment, and the 
repeat transmission of a packet. 
[0127] For example, when the error rate on the 
channel is lower than a predetermined value, retrans- 
mission control is performed, and when the error rate on 
the channel has a predetermined value or higher, at 
least one of the repeat transmission of a packet and the 
transmission of an FEC packet is performed in addition 
to the retransmission control. Or, when the error rate on 
the channel is lower than the predetermined value, no 
special control for recovering errors is performed, and 
when the error rate on the channel has a predetermined 
value or higher, at least one of the retransmission con- 
trol, the repeat transmission of a packet, and the trans- 
mission of an FEC packet is performed. 
[0128] While, the data transmission device of this 
fifth embodiment performs the transmission of input 
packets as well as the repeat transmission of a higher 
priority packet and the transmission of an FEC packet, 
the data transmission device can perform relay process- 
ing of relaying input packets successively input from the 
distribution server (transmitting end) to output the same 
to the receiving end as well as one of the repeat trans- 
mission of a higher priority packet and the transmission 
of an FEC packet. 

[01 29] In the first to fifth embodiments, the methods 
which are used in a data transmission device for relay- 
ing input packets which are successively input from the 
transmitting end and outputting the same to the receiv- 
ing terminal are described as a data transmission 
method. However, fundamental principles in data trans- 
mission methods according to respective claims of the 
present invention are not limited to the methods used in 
a relay server. For example, the fundamental principles 



can be applied to a method for relaying input packets 
which are successively input from a receiving terminal 
end and outputting the same to a transmitting end, or a 
method for transmitting data directly to a receiving ter- 
5 minal from a distribution server. 

Claims 

1. A data transmission method for performing relay 
10 processing of relaying plural input packets which 

are successively input from a transmitting end, to 
output the same to a receiving terminal, as well as 
performing at least one processing of processing of 
retransmitting an input packet which is instructed to 
is be retransmitted from the receiving terminal and 
processing of transmitting an correction packet con- 
taining an error correcting code for a predetermined 
input packet, comprising: 

20 decision processing of deciding a priority 

attached to each input packet from the trans- 
mitting end and priorities attached to at least 
one packet of the input packet which is 
instructed to be retransmitted and the correc- 
ts tion packet; and 

output processing of outputting the input pack- 
ets as well as outputting at least one packet of 
the input packet which is instructed to be 
retransmitted and the correction packet, 
30 wherein 

in the output processing, lower priority packets 
having priorities lower than a predetermined 
value, corresponding to a size of the input 
packet which is to be retransmitted or the cor- 
35 rection packet which is to be transmitted, are 

thinned out. 

2. A data transmission method for relaying plural 
packets which are successively input from a trans- 

40 mitting end, to output the same to a receiving termi- 
nal, comprising: 

decision processing of deciding a priority 
attached to the respective packet, and 
45 rearrangement processing of rearranging the 

successively input packets, with a group com- 
prising a predetermined number of packets as 
a process unit, such that the packets in each 
group are transmitted in the order of descend- 
so ing priorities, wherein 

in the rearrangement processing, a range of 
the packets in the respective group which are 
to be subjected to the rearrangement process- 
ing is decided such that all packets from a first 
55 input packet to a last input packet in the respec- 

tive group are received by the receiving termi- 
nal in time for reproduction times. 
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3. A data transmission method for relaying plural 
packets which are successively input from a trans- 
mitting end, to output the same to a receiving termi- 
nal, comprising: 

5 

decision processing of deciding a priority 
attached to the respective packet; and 
output processing of performing thinning -out 
processing for the plural packets to thin out part 
of the packets and outputting remaining pack- 10 
ets, wherein 

in the output processing, 
the thinning-out processing is performed for 
plural packets having same priorities, which are 
input from the transmitting end, such that inter- is 
vals between reproduction times of data corre- 
sponding to the respective plural packets 
received by the receiving terminal are equal. 

4. A data transmission method for relaying plural 20 
packets successively input from a transmitting end, 

to output the same to a receiving terminal, compris- 7. 
ing: 

decision processing of deciding a priority 25 
attached to the respective packet; and 
output processing of performing thinning-out 
processing for the plural packets to thin out part 
of the packets and outputting remaining pack- 
ets, wherein 30 
in the output processing, 
when lower priority packets having lower priori- 
ties, which lower priority packets are situated 
between two, i.e., former and latter higher prior- 
ity packets having higher priorities, are to be 35 
thinned out from the plural packets, thinning- 
out is performed successively from a lower pri- 
ority packet which is nearer to the latter higher 8. 
priority packet among the two higher priority 
packets. 40 

5. A data transmission method for relaying plural 
packets successively input from a transmitting end, 
to output the same to a receiving terminal, compris- 
ing: 45 

decision processing of deciding a priority 
attached to the respective packet; and 
output processing of performing thinning-out 
processing for the plural packets to thin out part so 
of the packets and outputting remaining pack- 
ets, wherein 

in the thinning-out processing in the output 
processing, 

plural packets having the same priorities are 55 
thinned out collectively. 



packets which are successively input from a trans- 
mitting end, to output the same to a receiving termi- 
nal, comprising: 

number decision processing of deciding a 
sequence numbers attached to the respective 
packet; 

priority decision processing of deciding a prior- 
ity attached to the respective packet; and 
output processing of performing thinning-out 
processing for the plural packets to thin out part 
of the packets and outputting remaining pack- 
ets, wherein 

in the thinning-out processing in the output 
processing, 

the sequence numbers of packets to be output 
are rewritten such that discontinuity in 
sequence numbers attached to the respective 
packets due to the thinning-out of packets does 
not occur. 

A data transmission method for relaying plural 
packets which are successively input from a trans- 
mitting end, to output the same to a receiving termi- 
nal, comprising: 

detection processing of detecting an error 
occurring rate on an output end channel; and 
when the error occurring rate is a predeter- 
mined rate or higher, performing at least one of 
repeat transmission processing of repeatedly 
outputting a predetermined packet, and correc- 
tion packet transmission processing of trans- 
mitting a correction packet containing an error 
correcting code which corresponds to a prede- 
termined packet. 

The data transmission method of Claim 7 compris- 
ing: 

decision processing of deciding a priority 
attached each of the respective packets which 
are successively input from the transmitting 
end; and 

performing, only to packets having priorities of 
a predetermined value or higher, at least one 
processing of the repeat transmission process- 
ing and the correction packet transmission 
processing. 



6. A data transmission method for relaying plural 
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(54) Data transmission method 

(57) In a data transmission method of the present 
invention, not only when relay of input packets is per- 
formed but also transmission of a retransmission packet 
or a correction packet is performed, changes in an out- 
put rate due to output rate control is suppressed, and 
data transmission is efficiently performed according to a 
capacity of an output channel. A data transmission 
device comprises a packet priority decision unit 15 for 
deciding priorities of input packets, a retransmission 
packet, and an FEC packet, an output delay calculation 
unit 17 for calculating a delay time until data of the 
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respective packets is reproduced by a receiving termi- 
nal, and an FEC packet generation unit 1 9 for generat- 
ing an FEC packet containing an error correcting code 
which corresponds to a packet designated on the basis 
of the priorities of the respective packets. When trans- 
mission of the retransmission packet and the FEC 
packet together with the input packets is performed, 
lower priority packets corresponding to a size of packets 
which are additionally transmitted are thinned out 
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The Search Division considers (hat the present European patent application does not comply with the 
requirements off unity ol invention and relates to several inventions or groups of inventions, namely: 

1. Claims: 1,2,3,5 

A data transmission method for performing relay processing 
of relaying plural input packets comprising: 

- deciding a priority attached to each input packet and the 
correction packet 

- lower priority packet(s) are thinned out depending on the 
size of the input packet which is to be retransmitted 



2. Claim : 4 

A data transmission method for relaying plural packets 
comprising: 

- deciding a priority attached to the respective packet 

- thin out lower priority packets, situated between two 
former and latter higher priority packets, which are nearer 
to the latter higher priority packet among the two higher 
priority packets. 



3. Claim : 6 

A data transmission method for relaying plural packets 
comprising: 

- deciding a sequence number attached to the respective 
packet 

- deciding a priority attached to the respective packet 

- the sequence numbers of packets to be output after 
thinning-out processing are rewriten such that discontinuity 
1n sequence due to thinning-out does not occur. 



4. Claims: 7-8 

A data transmission method for relaying plural packets 
comprising: 

- detecting an error occurring rate on an output end channel 

- 1f the error occurring rate is a predetermined rate or 
higher, perform at least the repeat transmission of a 
predetermined packet or a correction packet containing an 
error correcting code which corresponds to a predetermined 
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